Method for controlling edit user interface of moving picture for clip alignment control and apparatus for the same

ABSTRACT

Disclosed herein is a video editing UI control apparatus. A video editing UI control apparatus according to the present disclosure may include: an editing UI display unit for visually displaying an editing UI comprising a play head and a clip movement control UI in a display unit; a user input confirmation unit for confirming user input information based on a user input that is provided through a touch input in the display device; and an editing UI processing unit for confirming an input of the clip movement control UI based on the user input information provided by the user input confirmation unit and for moving at least one clip to a reference time in which the play head is located.

CROSS REFERENCE TO RELATED APPLICATION

The present application claims priority to Korean Patent Application No.10-2019-0138782, filed Nov. 1, 2019, the entire contents of which areincorporated herein for all purposes by this reference.

BACKGROUND OF THE INVENTION Field of the Invention

The present disclosure relates to a method and apparatus for controllinga user interface, and more particularly, to a method and apparatus forproviding and controlling a user interface used for video editing.

Description of the Related Art

Recently, portable terminals such as smart phones and tablets are widelyused, and the performance advances of such portable terminals and thedevelopment of wireless communication technology allow users to shoot,edit, and share videos using portable terminals.

However, due to limitations in LCD size and hardware performance, userscannot edit videos by using a portable terminal as smoothly as in thegeneral PC environment. In order to alleviate such inconvenience, userdemand for a video editing method that can be used in a portableterminal is increasing.

In addition, as the needs of users of portable terminals are on therise, the performance of camera, display and other hardware in portableterminals are being advanced, and many functions or services that usedto be available only in the PC environment have been replaced byportable terminals. Particularly, as each portable terminal has a cameraas a basic component, the needs of users for editing images or videosshot by cameras are increasing.

SUMMARY OF THE INVENTION

Although video editing technology has been diffused to use only limitedfunctions due to the resource characteristics of portable terminals, theusers' demand for video editing increases up to a level comparable tothe PC environment.

Meanwhile, when editing a video using a mouse, a keyboard or other inputdevices in the PC environment, a user's action to operate an inputdevice is required. However, as such an input device does not operate assmoothly as desired, the user's convenience is degraded, which is aproblem.

A portable terminal is generally equipped with a display supportingtouch input. When processing a user's input through a display supportingtouch input, the user's input may be processed more intuitively and theuser's convenience may be significantly improved.

In view of the foregoing description, one technical object of thepresent disclosure is to provide an editing UI control method andapparatus that are capable of intuitively processing various functionsfor video editing.

Another technical object of the present disclosure is to provide anediting UI control method and apparatus that are capable of easilycontrolling the movement of at least one clip or layer included in avideo project by using a play head.

Another technical object of the present disclosure is to provide anediting UI control method and apparatus that are capable of processingthe movement of at least one clip or layer only by selecting a clipmovement control UI.

The technical objects of the present disclosure are not limited to theabove-mentioned technical objects, and other technical objects that arenot mentioned will be clearly understood by those skilled in the artthrough the following descriptions.

According to one aspect of the present disclosure, a video editing UIcontrol apparatus may be provided. The apparatus may include: an editingUI display unit for visually displaying an editing UI including a playhead and a clip movement control UI in a display unit; a user inputconfirmation unit for confirming user input information based on a userinput that is provided through a touch input in the display device; andan editing UI processing unit for confirming an input of the clipmovement control UI based on the user input information provided by theuser input confirmation unit and for moving at least e clip to areference time in which the play head is located.

According to another aspect of the present disclosure, a video editingUI control method may be provided. The method may include: visuallydisplaying an editing UI including a play head and a clip movementcontrol UI in a display unit; confirming user input information based ona user input that is provided through a touch input in the displaydevice; and confirming the user input information and an input of theclip movement control UI based on the user input information and movingat least one clip to a reference time in which the play head is located.

The features briefly summarized above with respect to the presentdisclosure are merely exemplary aspects of the detailed descriptionbelow of the present disclosure, and do not limit the scope of thepresent disclosure.

According to the present disclosure, an editing UI control method andapparatus may be provided which are capable of easily controlling themovement of at least one clip or layer included in a video project byusing a play head.

Also, according to the present disclosure, an editing UI control methodand apparatus may be provided which are capable of processing themovement of at least one clip or layer only by selecting a clip movementcontrol UI, without having to select and move at least one clip or layerto a play head.

Also, according to the present disclosure, an editing UI control methodand apparatus may be provided which are incapable of significantlyimproving a user's convenience in moving at least one selected clip orlayer in an environment of portable terminal, since the at least oneclip or layer can be easily moved only by selecting an area providedwith a clip movement control UI after moving a play head to an area towhich the at least clip or layer is to be moved, without the necessityof performing drag input after selecting the at least one clip or layer.

Effects obtained in the present disclosure are not limited to theabove-mentioned effects, and other effects not mentioned above may beclearly understood by those skilled in the art from the followingdescription.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 a view exemplifying an electronic device to which variousembodiments of the present disclosure are applied.

FIG. 2 is a view for describing a system hierarchy of an electronicdevice to which various embodiments of the present disclosure areapplied.

FIG. 3 is a flow chart exemplifying an order of a video editing methodto which various embodiments of the present disclosure are applied.

FIG. 4 is a view exemplifying an editing UI provided in a video editingUI control apparatus according to various embodiments of the presentdisclosure.

FIG. 5A to FIG. 5E are views exemplifying a clip editing UI provided ina video editing UI control apparatus according to various embodiments ofthe present disclosure.

FIG. 6 is a block diagram exemplifying a configuration of a videoediting UI control apparatus according to various embodiments of thepresent disclosure.

FIG. 7A to FIG. 7H are views exemplifying a clip movement control UIprovided in a video editing UI control apparatus according to variousembodiments of the present disclosure.

FIG. 8 is an exemplary diagram of operation in which a clip movementcontrol UI is provided by a video editing UI control apparatus accordingto various embodiments of the present disclosure.

FIG. 9 is another exemplary diagram of operation in which a clipmovement control UI is provided by a video editing UI control apparatusaccording to various embodiments of the present disclosure.

DETAILED DESCRIPTION OF THE INVENTION

Hereinbelow, exemplary embodiments of the present disclosure will bedescribed in detail with reference to the accompanying drawings suchthat the present disclosure can be easily embodied by one of ordinaryskill in the art to which this invention belongs. However, the presentdisclosure may be variously embodied, without being limited to theexemplary embodiments.

In the description of the present disclosure, the detailed descriptionsof known constitutions or functions thereof may be omitted if they makethe gist of the present disclosure unclear. Also, portions that notrelated to the present disclosure are omitted in the drawings, and likereference numerals designate like elements.

In the present disclosure, when an element is referred to as being“coupled to”, “combined with”, or “connected to” another element, it maybe connected directly to, combined directly with, or coupled directly toanother element or be connected to, combined directly with, or coupledto another element, having the other element intervening therebetween.Also, it should be understood that when a component “includes” or “has”an element, unless there is another opposite description thereto, thecomponent does not exclude another element but may further include theother element.

In the present disclosure, the terms “first”, “second”, etc. are onlyused to distinguish one element, from another element. Unlessspecifically stated otherwise, the terms “first”, “second”, etc. do notdenote an order or importance. Therefore, a first element of anembodiment could be termed a second element of another embodimentwithout departing from the scope of the present disclosure. Similarly, asecond element of an embodiment could also be termed a first element ofanother embodiment.

In the present disclosure, components that are distinguished from eachother to clearly describe each feature do not necessarily denote thatthe components are separated. That is, a plurality of components may beintegrated into one hardware or software unit, or one component may bedistributed into a plurality of hardware or software units. Accordingly,even if not mentioned, the integrated or distributed embodiments areincluded in the scope of the present disclosure.

In the present disclosure, components described in various embodimentsdo not denote essential components, and some of the components may beoptional. Accordingly, an embodiment that includes a subset ofcomponents described in another embodiment is included in the scope ofthe present disclosure. Also, an embodiment that includes the componentsdescribed in the various embodiments and additional other components areincluded in the scope of the present disclosure.

Various embodiments of the present disclosure may be implemented in asmart phone, a tablet and other electronic devices equipped with displayunits. A video editing apparatus according to an embodiment of thepresent disclosure may be implemented by an electronic device equippedwith a video editing application. Alternatively, the video editingapparatus may be implemented by an electronic device equipped with animage processing unit and a controlling unit capable of processing avideo and subtitles data.

Preferably, an electronic device, to which various embodiments of thepresent disclosure are applied, means a portable electronic device.

FIG. 1 a view exemplifying an electronic device to which variousembodiments of the present disclosure are applied. That is, FIG. 1 is ablock diagram showing an electronic device 101 in a network environment100.

Referring to FIG. 1 , the electronic device 101 in the networkenvironment 100 may communicate with an electronic device 102 through afirst network 198 (e.g., short-range wireless communication) orcommunicate with an electronic device 104 or a server 108 through asecond network 199 (e.g., long-range wireless communication). Accordingto an embodiment, the electronic device 101 may communicate with theelectronic device 104 through the server 108. According to anembodiment, the electronic device 101 may include a processor 120, amemory 130, an input device 150, a sound output device 155, a displaydevice 160, an audio module 170, an interface 177, a camera module 180,a power management module 188, a battery 189, and a communication module190. In a certain embodiment, the electronic device 101 may omit atleast one (e.g., the display device 160 or the camera module 180) of thecomponents or include another component.

The processor 120 may control at least one of the other components(e.g., hardware or software components) of the electronic device 101connected to the processor 120, for example, by deriving software e.g, aprogram 140) and perform processing and operation for various data. Theprocessor 120 may process a command or data received from anothercomponent (e.g., the communication module 190) by loading the command ordata in a volatile memory 132 and store result data in non-volatilememory 134. According to an embodiment, the processor 120 may beoperated independently of a main processor 121 (e.g., a CPU or anapplication processor) and additionally or alternatively use less powerthan the main processor 121 or include a coprocessor 123 specialized ina designated function (e.g., a graphics processing unit, an imagesignaling processor, a sensor hub processor, or a communicationprocessor). Herein, the coprocessor 123 may be operated independently ofor by being embedded in the main processor 121.

In this case, the coprocessor 123 may control at least some functions orstates associated with at least one (e.g., the display device 160 or thecommunication module 190) of the components of the electronic device101, instead of the main processor 121 while the main processor 121 isin an inactive (e.g., sleep) state or along with the main processor 121while the main processor 121 is in an active (e.g., applicationoperating) state. According to an embodiment, the coprocessor 123 (e.g.,an image signaling processor or a communication processor) may beimplemented as a component of another functionally associated component(e.g., the camera module 180 or the communication module 190). Thememory 130 may store various data used by at least one component (e.g.,the processor 120), that is, input data or output data for software(e.g., the program 140) and a command associated therewith. The memory130 may include the volatile memory 132 or the non-volatile memory 134.

As software stored in the memory 130, the program 140 may include, forexample, an operating system 142, middle ware 144 or an application 146.

The input device 150 is a device for receiving a command or data to beused for a component (e.g., the processor 120) of the electronic device101 from the outside (e.g., a user) of the electronic device 101. Theinput device 150 may include a microphone, a mouse or a keyboard.

The sound output device 155 is a device for outputting an acousticsignal to the outside of the electronic device 101. The sound outputdevice 155 may include a speaker used for a general purpose likemultimedia play or playback and a receiver used exclusively forreceiving telephone calls. According to an embodiment, a receiver may beintegrated with or separate from a speaker.

The display device 160 is a device for visually provide a user withinformation of the electronic device 101. The display device 160 mayinclude, for example, a display, a hologram device, or a projector and acontrol circuit for controlling the device. According to an embodiment,the display device 160 may include touch circuitry or a pressure sensorcapable of measuring a pressure intensity for a touch. Correspondingly,based on touch circuitry or a pressure sensor, the display device 160may detect a coordinate of a touched input region, the number of touchedinput regions and a touched input gesture, and provide a detectionresult to the main processor 121 or the coprocessor 123.

The audio module 170 may bidirectionally convert a sound and anelectrical signal. According to an embodiment, the audio module 170 mayobtain a sound through the input device 150 or output a sound throughthe sound output device 155 or an external electronic device (e.g., theelectronic device 102 (e.g., a speaker or a headphone)) wired orwirelessly connected to the electronic device 101.

The interface 177 may support a designated protocol capable of wired orwireless connection to an external electronic device (e.g., theelectronic device 102). According to an embodiment, the interface 177may include a high definition multimedia interface (HDMI), a universalserial bus (USB) interface, a SD card or an audio interface.

A connection terminal 178 may include a connected capable of physicallyconnecting the electronic device 101 and an external electronic device(e.g., the electronic device 102), for example, a HDMI connector, a USBconnector, a SD card connector or an audio connector (e.g., a headphoneconnector).

The camera module 180 may shoot a still image and a moving image.According to an embodiment, the camera module 180 may include one ormore lenses, an image sensor, an image signal processor or a flash.

The power management module 188 is a module for managing power suppliedto the electronic device 101 and may be, for example, a part of a powermanagement integrated circuit (PMIC).

The battery 189 is a device for supplying power to at least onecomponent of the electronic device 101 and may include, for example, anon-rechargeable primary cell, a rechargeable secondary cell or a fuelcell.

The communication module 190 may establish a wired or wirelesscommunication channel between the electronic device 101 and an externalelectronic device (e.g., the electronic device 102, the electronicdevice 104, or the server 108) and support the execution ofcommunication through the established communication channel. Thecommunication module 190 may include one or more communicationprocessors that are operated independently of the processor 120 andsupport wired or wireless communication. According to an embodiment, thecommunication module 190 may include a wireless communication module 192(e.g., a cellular communication module, a short-range wirelesscommunication module, or a global navigation satellite system (GNSS)) ora wired communication module 194 (e.g., a local area network (LAN)communication module, or a power line communication module) andcommunicate with an external electronic device by using a correspondingcommunication module through a first network 198 (e.g., a short-rangecommunication network like Bluetooth, BLE (Bluetooth Low Energy), WiFidirect or IrDA (Infrared Data Association)) or a second network 199(e.g., a long-range communication network like a cellular network, theInternet or a computer network (e.g., LAN or WAN)). The various types ofcommunication modules 190 described above may be implemented as a singlechip or separate chips respectively.

Among the above components, some components may exchange a signal (e.g.,a command or data) by being connected with each other through acommunication type (e.g., bus, general purpose input/output (GPIO),serial peripheral interface (SPI)) among peripheral devices or a mobileindustry processor interface (MIPI).

According to an embodiment, a command or data may be transmitted orreceived between the electronic device 101 and the external electronicdevice 104 through the server 108 connected to the second network 199.Each electronic device 102 and 104 may be a device of a same type as ora different type from the electronic device 101. According to anembodiment, all or some of the operations performed in the electronicdevice 101 may be performed in another external electronic device or ina plurality of external electronic devices. According to an embodiment,when the electronic device 101 has to execute a function or serviceeither automatically or at a request, the electronic device 101 mayrequest at least some functions associated with the function or serviceto an external electronic device either additionally or instead ofexecuting the function or service by itself. When receiving the request,the external electronic device may execute the requested function orservice and deliver a corresponding result to the electronic device 101.The electronic device 101 may provide the requested function or serviceby processing the received result either as it is or additionally. Forthis, for example, cloud computing technology, distributed computingtechnology, or client-server computing technology may be used.

FIG. 2 is a view for describing a system hierarchy of an electronicdevice to which various embodiments of the present disclosure areapplied.

Referring to FIG. 2 , an electronic device 200 may be configured byincluding a hardware layer 201 corresponding to the electronic device100 of FIG. 1 , an operating system (OS) layer 200 as an upper layer ofthe hardware layer 210 for managing the hardware layer 210, and aframework layer 230 and an application layer 240 as upper layers of theOS layer 220.

The OS layer 220 controls the overall operation of the hardware layer210 and manages the hardware layer 210. That is, the OS layer 220 is alayer executing basic functions including hardware management, memoryand security. The OS layer 220 may include a display driver for drivinga display device, a camera driver for driving a camera module, an audiodriver for driving an audio module and any similar driver for operatingor driving a hardware device installed in an electronic device. Inaddition, the OS layer 220 may include a runtime and a libraryaccessible to a developer.

There is the framework layer 230 as an upper layer of the OS layer 220.The framework layer 230 links the application layer 240 and the OS layer220. That is, the framework layer 230 includes a location manager, anotification manager and a frame buffer for displaying a video on adisplay unit.

The application layer 240 for implementing various functions of theelectronic device 100 is located in an upper layer of the frameworklayer 230. For example, the application layer 240 may include variousapplication programs like a call application 241, a video editingapplication 242, a camera application 243, a browser application 244,and a gesture application 245.

Furthermore, the OS layer 220 may provide a menu or UI capable of addingor deleting at least one application or application program included inthe application layer 240. Accordingly, at least one application orapplication program included in the application layer 240 may be addedor deleted by a user. For example, as described above, the electronicdevice 100 of FIG. 1 may be connected to another electronic device 102and 104 or the server 108 via communication. At a user's request, theelectronic device 100 may receive and store data (that is, at least oneapplication or application program) from the another electronic device102 and 104 or the server 108 and include the data in a memory. Herein,the at least one application or application program stored in the memorymay be configured and operated in the application layer 240. Inaddition, at least one application or application program may beselected by a user through a menu or UI provided by the OS layer 220.The at least one application or application program thus selected may bedeleted.

Meanwhile, when a user control command input through the applicationlayer 240 is input into the electronic device 100, as the input controlcommand is delivered from the application layer 240 to the hardwarelayer 210, a specific application corresponding to the command may beimplemented and a corresponding result may be displayed in the displaydevice 160.

FIG. 3 is a flow chart exemplifying an order of a video editing methodto which various embodiments of the present disclosure are applied.

Referring to FIG. 3 , first, a video editing method may be implementedby the above-described electronic device, and the implementation maystart, when a video editing application is selected and implemented by auser input (S301).

When the video editing application is implemented, the electronic devicemay output an initial screen of the video editing application to adisplay device (e.g., display). An initial screen may provide a menu (orUI) for creating a new video project and a video project selection menu(or UI) for selecting a video project already being edited. In such aninitial screen, when a menu (or UI) for creating a new video project isselected, the step S303 may be performed. When a video project selectionmenu (or UI) is selected, the step S305 may be performed.

In the step S303, the electronic device may provide a menu (or UI) forsetting basic information of a new video project and set and apply thebasic information input through the menu (UI) to the new video project.For example, basic information may include a screen ratio of a new videoproject. Based on this, the electronic device may provide a menu (or UI)for selecting a screen ratio like 16:9, 9:16 and 1:1 and set and apply ascreen ratio input through the menu (UI) to a new video project.

Next, by reflecting basic information set in the step S303, theelectronic device may create a new video project and store the new videoproject thus created in a storing medium (S304).

Although an embodiment of the present disclosure presents a screen ratioas basic information, the present disclosure is not limited to theembodiment, which may be modified in various ways by those skilled inthe art. For example, an electronic device may provide a menu (or UI)for setting at least one of the automatic control of master volume, amaster volume size, a basic audio fade-in setting, a basic audiofade-out setting, a basic video fade-in setting, a basic video fade-outsetting, a basic setting of an image clip, a basic setting of a layerlength, and basic settings of image clip pan & zoom. The electronicdevice may set a value input through the menu (or UI) as basicinformation of a new video project.

For another example, an electronic device may automatically setpredetermined values for automatic control of master volume, a mastervolume size, a basic audio fade-in setting, a basic audio fade-outsetting, a basic video fade-in setting, a basic video fade-out setting,a basic setting of an image clip, a basic setting of a layer length, andbasic settings of image clip pan & zoom. In addition, an electronicdevice may provide a setting menu (or UI) and receive inputs of controlvalues for automatic control of master volume, a master volume size, abasic audio fade-in setting, a basic audio fade-out setting, a basicvideo fade-in setting, a basic video fade-out setting, a basic settingof an image clip, a basic setting of a layer length, and basic settingsof image clip pan & zoom. The electronic device may also set theabove-described basic information according to the input values.

Meanwhile, in the step S305, the electronic device may provide a projectlist including a video project stored in the storing medium and anenvironment in which at least one video project included in the projectlist may be selected. Through the environment described above, a usermay select at least one video project included in the project list, andthe electronic device may load at least one video project selected bythe user (S306).

In the step S307, the electronic device may provide an editing UI. Theediting UI may include a video display window 401, a media settingwindow 402, a media input window 403, a clip display window 404, and aclip setting window 405. In an editing UI, a video display window, amedia setting window and a media input window may appear in the upperpart of the display, while a clip display window and a clip settingwindow may appear in the lower part of the display.

The media setting window may include an export menu, a capture menu anda setting menu. The export menu, the capture menu and the setting menumay be provided in forms of icon or text enabling these menus to berecognized.

The media input window may include a media input menu 403A, a layerinput menu 403B, an audio input menu 403C, a voice input menu 403D and ashooting menu 403E. The media input menu 403A, the layer input menu403B, the audio input menu 403C, the voice input menu. 403D and theshooting menu 403E may be provided in forms of icon or text enablingthese menus to be recognized. In addition, each menu may include asub-menu. When each menu is selected, the electronic device mayconfigure and display a corresponding sub-menu.

For example, the media input menu 403A may be connected to a mediaselection window as a sub-menu, and the media selection window mayprovide an environment in which media stored in a storing medium can beselected. The media selected through the media selection window may beinserted into and displayed in a clip display window. The electronicdevice may confirm a type of media selected through the media selectionwindow. The electronic device may set a clip time of the media andinsert and display the clip time in the clip display window byconsidering the confirmed type of media. Here, the type of media mayinclude an image, a video and the like. When the type of media is animage, the electronic device may confirm a basic set value of length ofan image clip and set an image clip time according to the basic setvalue of length of the image clip. In addition, when the type of mediais a video, the electronic device may set a video clip time according tothe length of the video.

The layer input menu 403B may include, as sub-menus, a media input menu,an effect input menu, an overlay input menu, a text input menu, a mediainput menu, and a drawing input menu.

A media input menu may be configured in a same way as theabove-described media input menu.

An effect input menu may provide an environment to select a blurringeffect, a mosaic effect, a noise effect, a sandstorm effect, a meltingpoint effect, a crystal effect, a star filter effect, a display boardeffect, a haze effect, a fisheye lens effect, a magnifying lens effect,a flower twist effect, a night vision goggle effect, and a sketcheffect. An effect selected through the effect input menu may be insertedand displayed in a clip display window. Herein, an electronic device mayconfirm a basic set value of layer length and set an effect clip timeaccording to the basic set value of layer length.

An overlay input menu may provide an environment to select various formsor shapes of stickers and icons. A sticker and an icon selected throughthe overlay input menu may be inserted and displayed in a clip displaywindow. Herein, an electronic device may confirm a basic set value oflayer length and set clip time for sticker, icon and the like accordingto the basic set value of layer length.

A text input menu may provide an environment to input a text, that is, aQWERTY keyboard. A text selected through the text input menu may beinserted and displayed in a clip display window. Herein, an electronicdevice may confirm a basic set value of layer length and set a text cliptime according to the basic set value of layer length.

A drawing input menu may provide a drawing area to a video displaywindow and be configured such that a drawing object is displayed in atouch input area of the video display window. A handwriting input menumay include, as sub-menus, a drawing tool selection menu for selecting adrawing tool, a color selection menu for selecting a drawing color, athickness setting menu for setting thickness of a drawing object, apartial delete menu for deleting a created drawing object, and an entiredelete menu for deleting an entire object that has been drawn. Inaddition, when a handwriting input menu is selected, an electronicdevice may confirm a basic set value of layer length and set a drawingobject clip time according to the basic set value of layer length.

The audio input menu 403C may be connected to an audio selection windowas a sub-menu. The audio selection window may provide an environment toselect an audio file stored in a storage medium. An audio file selectedthrough the audio selection window may be inserted and displayed in aclip display window.

The voice input menu 403D may be a menu for recording a sound inputthrough a microphone. When the voice input menu is selected by a user,an electronic device may detect an audio signal input through amicrophone by activating the microphone included in the electronicdevice. In addition, the electronic device may show a start recordingbutton. When the start recording button is input, audio signals maystart being recorded. Furthermore, the electronic device may visuallydisplay audio signals input through the microphone. For example, theelectronic device may confirm a size or frequency feature of an audiosignal and display the feature thus confirmed in a form of level meteror graph.

The shooting menu 403E is a menu for shooting an image or a video thatis input through a camera module provided to an electronic device. Theshooting menu 403E may be shown by an icon or the like visualizing acamera device. The shooting menu 403E may include an image/videoshooting selection menu, as a sub-menu, for selecting a camera forcapturing an image or a camcorder for shooting a video. Based on this,when the shooting menu 403E is selected by a user, the electronic devicemay display the image/video shooting selection menu. In addition, theelectronic device may activate an image shooting mode or a videoshooting mode of a camera module according to what is selected throughthe image/video shooting selection menu.

The clip display window 404 may include at least one clip line fordisplaying clips corresponding to media, effects, overlays, texts,drawings, audio or speech signals that are input through the media inputwindow.

A clip line may include a main clip line 404A and a sub clip line 404B.The main clip line 404A may be a clip line provided at the top of a clipdisplay window, and the sub clip line 404B may be at least one clip lineprovided below the main clip line 404A.

An electronic device may display the main clip line 404A by fixing themain clip line 404A at the top of a clip display window. The electronicdevice may confirm a drag input in an area, in which the sub clip line404B exists, and display the sub clip line 404B by scrolling the subclip line 404B up and down in response to a direction of the drag input.

Furthermore, when the direction of the drag input is an upwarddirection, the electronic device may display the sub clip line 404B bymoving the sub clip line 404B to an upper area. When the direction ofthe drag input is a downward direction, the electronic device maydisplay the sub clip line 404B by moving the sub clip line 404B to alower area. In addition, the electronic device may differently displaythe vertical width of the main clip line 404A in response to themovement of the sub clip line 404B. For example, when the sub clip line404B moves upwards, the vertical width of the main clip line 404A may bedecreased. When the sub clip line 404B moves downwards, the verticalwidth of the main clip line 404A may be increased.

In particular, a clip display window may include a time display line404C for indicating a time of a video project and a play head 404D. Thetime display line 404C may be displayed on top of the main clip line404A described above and include figures or ticks in predeterminedunits. In addition, the play head 404D may be displayed as a verticalline starting from the time display line 404C to the bottom of the clipdisplay window. The play head 404D may be shown in a color (e.g., red)that may be easily recognized by a user.

Furthermore, the play head 404D may be provided with a fixed form in apredetermined area. Objects included in the main clip line 404A and thesub clip line 404B and the time display line 404C, which are provided inthe clip display window, may be so configured as to move horizontally.

For example, when a drag input horizontally occurs in an area in whichthe main clip line 404A, the sub clip line 404B and the time displayline 404C are located, the electronic device may horizontally move anddisplay the time display line 404C and objects included in the main clipline 404A and the sub clip line 404B. Herein, a frame or an objectcorresponding to the play head 404D may be so configured as to bedisplayed in the video display window. Also, the electronic device 404Dmay confirm a detailed time (e.g., 1/1000 second unit), in which theplay head is touched, and also display the confirmed detailed time inthe clip display window.

In addition, the electronic device may check whether or not multipletouches occur in the clip display window. When multiple touches occur,the electronic device may respond to the multiple touches by changingand displaying a tick or figure in a predetermined unit included in thetime display line 404C. For example, when an input is detected with agradually decreasing interval of multiple touches, the electronic devicemay display a tick or figure by decreasing an interval of the tick orfigure. When an input is detected with a gradually increasing intervalof multiple touches, the electronic device may display the tick orfigure by increasing the interval of the tick or figure.

The electronic device may configure the clip display window 404 suchthat a clip displayed in a clip line may be selected. When the clip isselected, the electronic device may visually show that the clip isselected. For example, when the electronic device detects that a clip isselected, the electronic device may display a boundary of the selectedclip in a predetermined color, for example, yellow.

Preferably, when it is detected that a clip is selected, the electronicdevice may provide a clip editing UI capable of editing the selectedclip. For example, the electronic device may display a clip editing UIin an area where the media input window 403 exists. A clip editing UImay be differently set according to the type of a selected clip.Specifically, when a type of clip is a video clip, the electronic deviceconfigure and provide a clip editing UI 500 by including a trim/splitmenu 501, a pan/zoom menu 502, an audio control menu 503, a clipgraphics menu 504, a speed control menu 505, a reverse control menu 506,a rotation/mirroring control menu 507, a filter menu 508, abrightness/contrast adjustment menu 509, a voice EQ control menu 510, adetailed volume control menu 511, a voice modulation menu 512, avignetting control menu 513, and an audio extraction menu 514.

A clip editing UI for each clip type may be configured based on thestructures of video editing UIs in FIG. 7A to FIG. 7G below. A clipediting UI may be configured with reference to FIG. 7A to FIG. 7G.

In addition, the electronic device may further display a clip editingexpansion UI 530 in an area in which a media setting window exists. Aclip editing expansion UI displayed in an area of media setting windowmay be also differently set according to a type of a selected clip. Forexample, when a type of clip is a video clip, an image clip, an audioclip or a voice signal clip, the electronic device may configure andprovide the clip editing expansion UI 530 including a clip delete menu,a clip copy menu and a clip layer copy menu. When a type of clip is aneffect clip, a text clip, an overlay clip or a drawing clip, theelectronic device may configure and provide the clip editing expansionUI including a clip delete menu, a clip copy menu, a bring to frontmenu, a bring forward menu, a send backward menu, a send to back menu, ahorizontal center alignment menu, and a vertical center alignment.

A clip setting window may include a clip expansion display menu 550 anda clip movement control menu 560. When the clip expansion display menu550 is selected by a user, the electronic device may display a clipdisplay window by expanding the window to the entire area of display. Inaddition, when the clip movement control menu 560 is selected, theelectronic device may display a clip by moving the clip to a play head.Furthermore, the clip movement control menu 560 may include a start areamovement menu or an end area movement menu. The start area movement menuor the end area movement menu needs to be adaptively displayed byconsidering the position of a play head touching a clip. For example,the electronic device may basically provide the start area movementmenu. When a clip touches the start position of a play head, the startarea movement menu may be replaced by the end area movement menu.

In the step S308, the electronic device may confirm a user input that isinput through an editing UI, configure a corresponding video project andstore the configured video project in a storage medium.

As described above, an editing UI may be configured to include an exportmenu in a media setting window. When the export menu is selected by auser (e.g., S309), the electronic device may configure video data byreflecting information that is configured in a video project and storethe video data in a storage medium (S310).

FIG. 6 is a block diagram exemplifying a configuration of a videoediting UI control apparatus according to various embodiments of thepresent disclosure.

Referring to FIG. 6 , a video editing UI control apparatus 60 accordingto various embodiments of the present disclosure may include an editingUI display unit 61, a user input confirmation unit 63 and an editing UIprocessing unit 65.

The editing UI display unit 61 may visually display the above-describedediting UI in a display device (e.g., a display). In particular, theediting UI display unit 61 may confirm a menu or UI, which is to beoutput at the request of the editing UI processing unit 65, and outputthe menu or UI in the display device (e.g., the display). Herein, theediting UI may include at least one menu or UI having a predeterminedform and size and be configured such that at least one menu or UI isdisplayed in a predetermined area.

An editing UI, which the editing UI display unit 61 outputs through adisplay, will be described in detail with reference to FIGS. 7A to 7Hbelow.

Based on a coordinate of a touch-input area, the number of touch-inputareas and a touch-input gesture that are provided through theabove-described display device 160 (refer to FIG. 1 ), the user inputconfirmation unit 63 may confirm user input information such as acoordinate of a user input, a type of a user input (e.g., a single touchinput, a multi touch input, a single gesture input, a multi gestureinput, etc.) and a direction of (single or multi) gesture input andprovide the confirmed user input information to the editing UIprocessing unit 65.

The editing UI processing unit 65 may confirm the user input informationprovided by the user input confirmation unit 63 and process an operationcorresponding to the user input information. For example, the editing UIprocessing UI 65 may confirm a coordinate of user input and conform andprocess an operation corresponding to a menu or UI that exists at theconfirmed coordinate. As another example, the editing UI processing unit65 may confirm a sub-menu or sub-UI of the menu or UI, which exists atthe confirmed coordinate, and request the editing UI display unit 61 tooutput the confirmed sub-menu or sub-UI.

Particularly, the editing UI processing unit 65 may include a clipmovement control UI processing unit 67 for providing a clip movementcontrol UI. The clip movement control UI processing unit 67 may includea clip movement control UI management unit 67A, a play head confirmationunit 67B and a clip movement processing unit 67C.

A clip movement control UI may include a menu or UI that controls a clipmovement by using a play head. For example, the clip movement control UImay include a UI that moves a start point or end point of a clip to theplay head. In addition, as a clip movement basically requires confirmingor selecting a clip to be moved, a clip movement control UI may beprovided or enabled after the clip is confirmed or selected.

Based on the foregoing description, the clip movement control UImanagement unit 67A may confirm the selection of at least one clip,detect a clip movement control UI and request the editing UI displayunit 61 to output the clip movement control UI. As another example, theclip movement control UI management unit 67A may basically request theediting UI display unit 61 to display a clip movement control UI indisabled state. When at least one clip is confirmed to be selected, theclip movement control UI management unit 67A may request the editing UIdisplay unit 61 to enable the clip movement control UI.

It is preferable to configure a clip movement control UI to be displayedin a clip setting window 710 of an editing UI. Furthermore, anelectronic device to which a video editing UI control apparatus isapplied may be a portable terminal. Such a portable terminal may make itdifficult to configure a plurality of menus or UIs in the clip settingwindow 710. In this regard, a clip movement control UI may be providedas an extended menu 711 of the clip setting window 710. For example,when at least one clip 701 is selected, the clip movement control UImanagement unit 67A may request the editing UI display unit 61 todisplay the extended menu in the clip setting window 710. In response tothis, the editing UI display unit 61 may configure and display theextended menu 711 in the clip setting window 710 or in one area of theclip setting window 710.

As another example, the clip movement control UI management unit 67A mayrequest the editing UI display unit 61 to output a clip movement controlUI. The editing UI display unit 61 may display a clip movement controlUI 713 in place of some menu 712 (refer to FIG. 7B) in the clip settingwindow 710. For example, the editing UI display unit 61 may beconfigured to basically display a play head alignment menu 712 and todisplay the clip movement control UI 713 in place of the play headalignment menu 712, when the clip movement control UI management unit67A requests to display the clip movement control UI 713. Herein, as theplay head alignment menu 712 is a menu for moving the play head to astart or end point of a selected clip, a reference time for movement maybe set to the time of either the start point or end point of the clip.

The editing UI processing unit 65 may move layers 714 provided in a clipdisplay window left and right, and up and down, in response to userinput information occurring in the clip display window. Particularly,when a drag input to the left or right in a clip display window isconfirmed, the editing UI processing unit 65 may move the layers 714provided in the clip display window to the left or right, together witha time display line 715. Herein, a time (hereinafter, referred to as“reference time”) corresponding to a play head 716 may be confirmed anddisplayed.

In response to the operation of the editing UI processing unit 65, theplay head confirmation unit 67B may confirm and temporarily store areference time and provide the reference time at a request of the clipmovement processing unit 67C.

When the above-described clip movement control UI 713 is output throughthe editing UI display unit 61, the clip movement processing unit 67Cmay confirm the occurrence of a user input in an area, in which the clipmovement control UI 713 is displayed, and process a corresponding clipmovement. Specifically, the clip movement processing unit 67C mayconfirm that a user input occurs in an area in which the clip movementcontrol UI 713 (refer to FIG. 7C), and may request a reference time tothe play head confirmation unit 67B and receive the reference time. Inaddition, the clip movement processing unit 67C may move a start pointor end point of a selected clip 717 and 718 based on the confirmed time.

As another example, when moving the layers 714 provided in a clipdisplay window to the left or right according to a user input, the clipmovement control UI management unit 67A may manage the clip movementcontrol UI 713 to be adaptively displayed by considering the play head716 and the position of a start or end point of the selected clip 717.For example, when the start point of the selected clip 717 is located inan area to the left of the play head 716, the clip movement control UImanagement unit 67A may enable a clip start point movement UI 713A(refer to FIG. 7D) to be displayed. When the end point of the selectedclip 718 is located in an area to the might of the play head 716, theclip movement control UI management unit 67A may enable a clip end pointmovement UI 713B (refer to FIG. 7E) to be displayed.

In an embodiment of the present disclosure described above, the clipmovement control UI 713 includes the clip movement control UIs 713, 713Aand 713B. However, the present disclosure is not limited to theembodiment. Various menus or UIs capable of controlling a clip or layerbased on a play head or a time corresponding to the play head may beincluded in a clip movement control UI. For example, a clip movementcontrol UI may include a clip extension UI 713C. As the clip extensionUI 713C is a menu for extending a clip to a play head or a timecorresponding to the play head, the clip movement processing unit 67Cmay extend a start point or end point of a clip to the play head 716 ora time corresponding to the play head 716, in response to a selection ofthe clip extension UI 713C.

As another example, the clip extension UI 7130 may include a stark pointextension UI 713D (refer to FIG. 7G) or an end point extension UI 713E(refer to FIG. 7H). The clip movement processing unit 67C may extend astart point of a clip 717 to the play head 716 or a time correspondingto the play head 716 in response to a selection of the start pointextension UI 713D and extend an end point of a clip 718 to the play head716 or a time corresponding to the play head 716 in response to aselection of the end point extension UI 713E.

Hereinafter, an operation of providing a clip movement control UI willbe described with reference to FIGS. 7A to 7H described above and FIG. 8.

FIG. 8 is an exemplary diagram of operation in which a clip movementcontrol UI is provided by a video editing UI control apparatus accordingto various embodiments of the present disclosure.

First, the video editing UI control apparatus may provide a videoediting UI including a video display window, a media setting window, amedia input window, a clip display window and a clip setting window. Atleast one clip included in the clip display window may be selected(S801). For example, the video editing UI control apparatus may confirmthat a video clip is selected among multiple clips displayed in a clipdisplay window, when a touch input occurs in an area 701 in which thevideo clip exists.

In response, the video editing UI control apparatus may confirm a UI forediting a video clip, that is, a video clip edit menu, and replace themedia input window 700 (refer to FIG. 7A) by the video clip edit menu705. In addition, the video editing UI control apparatus may confirm anddisplay a clip movement control UI 713 (S802).

Next, the video editing UI control apparatus may confirm a user inputoccurring in the video clip edit menu 705 or the clip movement controlUI 713 (S803) and then process a corresponding operation. Particularly,as the video editing UI control apparatus may confirm a user inputoccurring in the clip display window 707 (refer to FIG. 7B), when a draginput occurs in the clip display window 707, the video editing UIcontrol apparatus may move at least one layer provided in the clipdisplay window 707 in a direction of the drag input (S804). For example,when a drag input to the left or right in the clip display window 707 isconfirmed, the video editing UI control apparatus may move the layers714 provided in the clip display window 707 to the left or right,together with the time display line 715. Herein, a reference time may beconfirmed and displayed (S805).

In the foregoing environment, when a user input occurs in an area inwhich the clip movement control UI 713 is displayed (S806), the videoediting UI control apparatus may process a corresponding clip movement(S807), That is, the video editing UI control apparatus may confirm thata user input occurs in an area in which the clip movement control UI 713exists, and confirm a reference time. In addition, the video editing UIcontrol apparatus may move the start points or end points of theselected clips 717 and 718 to the confirmed time.

In addition, the clip movement control UI 713 may include the clipextension UI 713C. In response, when a user input occurs in an area inwhich the clip extension UI 713C is displayed (S808), the video editingUI control apparatus may extend the start points or end points of thecorresponding clips 717 and 718 to the play head 716 (S809).

FIG. 8 illustrates an embodiment in which the clip movement control UImoves or extends a selected clip without distinction between a startpoint and an end point. However, the present disclosure is not limitedto the embodiment, and a selected clip may be moved or extended invarious ways. For example, a clip movement control UI may include theclip start point movement UI 713A for moving a start point of a clip toa reference time, the clip end point movement UI 713B for moving an endpoint of a clip to a reference time, the start point extension UI 713Cfor extending a start point of a clip to a reference time, and the endpoint extension UI 713D for extending an end point of a clip to areference time. Hereinafter will be described, referring to FIG. 9 ,operations of providing and controlling the clip start point movement UI713A, the clip end point movement UI 713B, the start point extension UI713C and the end point extension UI 713D.

FIG. 9 is another exemplary diagram of operation in which a clipmovement control UI is provided by a video editing UI control apparatusaccording to various embodiments of the present disclosure.

First, the steps S901 to S905 may be configured to be the same of thesteps S801 to S805 of FIG. 8 described above.

Next, the video editing UI control apparatus n may adaptively configurethe clip movement control UI 713 according to a user input confirmed inthe step S903 and display the clip movement control UI 713 (S906).Specifically, when moving the layers 714 provided in the clip displaywindow 707 to the left or right according to a user input, the videoediting UI control apparatus may adaptively display the clip movementcontrol UIs 713A and 713B by considering the play head 716 and thepositions of start or end points of the selected clips 717 and 718. Forexample, when the start point of the selected clip 717 is located in anarea to the left of the play head 716, the video editing UI controlapparatus may enable the clip start point movement UI 713A to bedisplayed. When the end point of the selected clip 718 is located in anarea to the right of the play head 716, the video editing UI controlapparatus may enable the clip end point movement UI 713B to bedisplayed.

In the foregoing environment, when a user input occurs in an area inwhich the clip movement control UI 713A is displayed (S907), the videoediting UI control apparatus may process a corresponding clip movement(S908). That is, the video editing UI control apparatus may confirm thata user input occurs in an area in which the clip start point movementcontrol UI 713A exists, and confirm a reference time. In addition, thevideo editing UI control apparatus may move the start point of theselected clip 717 to the confirmed reference time.

Likewise, when confirming that a user input occurs in an area in whichthe clip end point movement UI 713B (refer to FIG. 7D) (S909), the videoediting UI control apparatus may confirm a reference time and move theend point of the selected clip 718 to the confirmed reference time(S910).

In addition, the clip movement control UI 713 may include the startpoint extension UI 713D and the end point extension UI 713E. Inresponse, when a user input occurs in an area in which the start pointextension UI 713D is displayed (S911), the video editing UI controlapparatus may extend the start point of the corresponding clip 717 tothe play head 716 (S912). That is, the video editing UI controlapparatus may confirm that a user input occurs in an area in which thestart point extension UI 713D exists, and confirm a reference time. Inaddition, the video editing UI control apparatus may extend the startpoint of the selected clip 717 to the play head 716.

Likewise, when confirming that a user input occurs in an area in whichthe end point extension UI 713E (S913), the video editing UI controlapparatus may confirm a reference time and extend the end point of theselected clip 718 to the confirmed reference time on the play head 716.

The exemplary methods described herein were expressed by a series ofoperations for clear description, but it does not limit the order ofperforming the steps, and if necessary, the steps may be performed sinin different orders. In order to achieve the method of the presentdisclosure, other steps may be added to the exemplary steps, or theother steps except for some steps be included, or additional other stepsexcept for some steps may be included.

Various embodiments described herein are provided to not arrange allavailable combinations, but explain a representative aspect of thepresent disclosure and the configurations about the embodiments may beapplied individually or in combinations of at least two of them.

Further, various embodiments of the present disclosure may beimplemented by hardware, firmware, software, or combinations thereof.When hardware is used, the hardware may be implemented by at least oneof ASICs (Application Specific Integrated Circuits), DSPs (DigitalSignal Processors), DSPDs (Digital Signal Processing Devices), PLDs(Programmable Logic Devices), FPGAs (Field Programmable Gate Arrays), ageneral processor, a controller, a micro controller, and amicro-processor.

The scope of the present disclosure includes software anddevice-executable commands (for example, an operating system,applications, firmware, programs) that make the method of the variousembodiments of the present disclosure executable on a machine or acomputer, and non-transitory computer-readable media that keeps thesoftware or commands and can be executed on a device or a computer.

What is claimed is:
 1. A video editing UI control apparatus comprising:a display device configured for displaying an editing UI comprising aplay head and a clip movement control UI, wherein the display device isfurther configured to display a video frame, the video framecorresponding to a reference time indicated by the play head at aposition within the editing UI that corresponds to the reference time; auser input confirmation unit configured for confirming user inputinformation based on a user input that is provided through a touch inputin the display device; and an editing UI processing unit configured forconfirming an input of the clip movement control UI based on the userinput information provided by the user input confirmation unit andconfigured for moving a clip to automatically align a start point or anend point of the clip with the position within the editing UI thatcorresponds to the reference time; wherein the clip movement control UIcomprises a clip extension UI that extends the clip to align the startpoint or the end point of the clip with the reference timeautomatically; and wherein the editing UI processing unit is configuredto confirm the reference time and, in response to a selection of theclip extension UI, to extend the start point or the end point of theclip to the reference time.
 2. The video editing UI control apparatus ofclaim 1, wherein the clip includes video.
 3. The video editing UIcontrol apparatus of claim 1, wherein the clip includes an image.
 4. Thevideo editing UI control apparatus of claim 1, wherein the clip includesaudio.
 5. The video editing UI control apparatus of claim 1, wherein theclip includes a voice signal.
 6. A video editing UI control methodcomprising: displaying an editing UI comprising a play head and a clipmovement control UI in a display device; displaying a video frame, thevideo frame corresponding to a reference time indicated by the play headat a position within the editing UI that corresponds to the referencetime; confirming user input information based on a user input that isprovided through a touch input in the display device; and confirming theuser input information and an input of the clip movement control UIbased on the user input information and moving a clip to automaticallyalign a start point or an end point of the clip with the position withinthe editing UI that corresponds to the reference time; wherein the clipmovement control UI comprises a clip extension UI that extends the clipto align the start point or the end point of the clip with the referencetime automatically; and wherein the moving the start point or the endpoint of the clip comprises confirming the reference time and, inresponse to a selection of the clip extension UI, extending the startpoint or the end point of the clip to the reference time.
 7. The videoediting UI control method of claim 6, wherein the clip includes video.8. The video editing UI control method of claim 6, wherein the clipincludes an image.
 9. The video editing UI control method of claim 6,wherein the clip includes audio.
 10. The video editing UI control methodof claim 6, wherein the clip includes a voice signal.